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Abstract 
A number of studies have used variable-centered approaches to examine informant discrepancies 
on children’s behavior problems; however, few such studies have used person-centered 
approaches to explore patterns of informant discrepancies or correlates of discrepancies in 
informant symptom ratings. The present study addressed these gaps by examining profiles of 
informant agreement on internalizing and externalizing symptoms and examining whether two 
important contextual factors, parenting and school engagement, are associated with profile 
membership. Data from an at-risk, urban sample of youth participants (N = 346, M age = 12.47 
+/- 0.60 years, 56% male, and 75% Black), their caregivers, and one of their teachers were 
analyzed in the current study. Youth from 20 schools in a Mid-Atlantic state were screened for 
elevated levels of aggression and were selected to participate in the Early Adolescent Coping 
Power study. At baseline, youth, caregivers, and teachers reported on youth’s internalizing 
symptoms and caregivers and teachers reported on youth’s externalizing symptoms. Caregivers 
reported on their parenting; youth reported on their school engagement. Two internalizing 
symptoms profiles were identified: Low Symptoms Agreement and Youth-Reported High 
Somatization and Anxiety. Three externalizing symptoms profiles were identified: Low 
Symptoms Agreement, Teacher-Reported High Externalizing, and Caregiver-Reported High 
Externalizing. These profiles differed significantly on parenting behaviors and school 


engagement, shedding light on factors that may underlie informant discrepancies. 


Keywords: internalizing symptoms, externalizing symptoms, multiple informants, person- 


centered approach, parenting, school engagement 


INFORMANT DISCREPANCIES IN SYMPTOMS 3 


Introduction 

Internalizing and externalizing symptoms may occur in adolescence and place youth on a 
trajectory of socioemotional problems, poor academic performance, substance use, and peer and 
parental conflict (Bornstein, Hahn, & Haynes, 2010; Fanti & Henrich, 2010; King, Iacono, & 
McGue, 2004). Internalizing symptoms include anxiety, depression, and withdrawal, while 
externalizing symptoms include aggression, conduct problems, and hyperactivity (Bornstein, 
Hahn, & Haynes, 2010; Fanti & Henrich, 2010). Identifying these symptoms during adolescence 
can facilitate early intervention efforts to prevent the onset of adult psychopathology and 
improve youth socioemotional outcomes and academic success (Bornstein et al., 2010; Fanti & 
Henrich, 2010). 

However, the identification of these symptoms can be complicated. Often, youth’s 
symptoms manifest differently depending on the context, resulting in discrepant informant 
reporting of symptoms (e.g., Dirks et al., 2012). For example, meta-analyses show low to 
moderate correlations between multiple informants (De Los Reyes et al., 2015). The varying 
reporter perspectives both demonstrates the need to include multiple informants (De Los Reyes 
& Kazdin, 2005) and presents challenges. For example, a multi-informant approach is more 
costly and burdensome and few assessments can be adequately or meaningfully compared across 
informants (Alexander et al., 2017; Olino & Klein, 2015). However, ignoring discrepancies 
creates a missed opportunity to identify symptoms, and subsequently intervene or increase 
awareness among reporters who may not notice symptoms. Although research has established 
that discrepancies are common (De Los Reyes et al., 2015), less is known about factors 
associated with informant consensus or discrepancies regarding youth’s symptoms. The current 


study aimed to identify profiles of informant agreement on internalizing and externalizing 
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symptoms, and then explored whether parenting behaviors and school engagement were 
associated with profile membership. 
The Utility of a Multi-Informant Approach 

Previous research has shown limitations in using single-informant reports when making 
clinical and treatment decisions, estimating prevalence, and determining impact of internalizing 
and externalizing symptoms on a child (De Los Reyes et al., 2015). Because of the context 
dependency of behavior, one informant may only report on functioning that they observe in that 
context, missing symptoms that occur in other contexts. Thus, one informant may not accurately 
and completely describe symptomology, which may potentially result in misdiagnosis or an 
inappropriate treatment plan (Goolsby et al., 2018). 

There are two primary statistical approaches to examine multi-informant data in research, 
which include variable-centered and person-centered methods. A variable-centered approach is 
focused on how two or more variables relate to one another (e.g., predictors and outcomes; how 
groups differ) and assumes that the sample’s response on a given variable is primarily 
homogenous (Laursen & Hoff, 2006). This is the most commonly-used approach and is made 
possible by combining rater reports (e.g., summing or averaging) to create overall scores (De Los 
Reyes & Kazdin, 2004) and examining correlations in informant reports across the sample 
(Sinclair et al., 2019). In contrast, a person-centered approach assumes that the sample’s 
response on a given variable is more likely to be heterogeneous, and it is used to examine 
whether subgroups exist within a sample and differ on variables of interest (Laursen & Hoff, 
2006). One person-centered approach is latent profile analysis (LPA), which can allow for the 
identification of subgroups that exhibit different patterns and degrees of rater agreement or 


discrepancy (Masyn, 2013). LPA also allows one to investigate whether certain variables, such 
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as context- or rater-specific factors, are associated with profile membership, which may shed 
light on factors that contribute to discrepancies. 
Factors Related to Reporter Discrepancies 

Consistent with Bronfenbrenner’s (1979) social ecological theoretical model, youth 
development is influenced by many environments (most notably, home and school) and people 
with whom they come into contact within these settings. Because behavior is often context 
specific, rater discrepancies may be related to behavioral differences in the home or school that 
relate to contextual factors. Of specific interest, are malleable environmental factors that have 
been shown to be associated with youth behavior and are responsive to intervention, including 
relationships at school and parenting strategies. 

School Context. Youth’s connection to their teachers may be associated with teacher 
report of symptoms, although there is a dearth of research in this area. Extant research indicates 
that higher levels of teacher-reported familiarity with students is associated with fewer parent- 
teacher rater discrepancies of internalizing symptoms (Ines & Sacco, 1992). By extension, a 
student’s relationships with other students and general school connectedness may also relate to 
informant discrepancies. Teachers’ perceptions of youth’s psychosocial functioning, such as 
acting-out, moodiness, and depression, are associated with their perception of the quality of the 
child’s peer relationships (Totura et al., 2009). Thus, if a student experiences poor peer 
relationships and school connectedness, teachers may report higher levels of symptoms. 

Children with learning problems may demonstrate a range of behaviors (e.g., withdrawal, 
inattention, disruptiveness) in the classroom to avoid the demands of the school environment, 
including classwork or in response to frustration. This may lead teachers to report higher levels 


of externalizing or internalizing symptoms for students with learning problems (Totura et al., 
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2009). Thus, students with behavioral and learning challenges often have lower school 
engagement, which may be associated with rater discrepancies (Totura et al., 2009). 

Home Context. Parenting behaviors may influence the elicitation of symptoms (Van heel 
et al., 2019), as well as the parent’s perception of those symptoms. Although research has 
examined indices of family structure (e.g., family dysfunction) in relation to informant 
discrepancies, few studies have examined parenting behaviors. Available work indicates that 
greater parent-reported stress and lower family cohesion predicted greater parent-child 
discrepancies for internalizing symptoms (Kolko & Kazdin, 1993). Further, parents who report 
greater acceptance of their child demonstrate higher parent-child agreement on externalizing 
symptoms (Al Ghriwati et al., 2018). 

Specific parent behaviors of interest that may relate to informant discrepancies are 
parental monitoring and positive parenting, given their known associations with youth’s 
internalizing and externalizing symptoms (Eisenberg et al., 2005; Racz & McMahon, 2011). For 
example, higher parental monitoring is associated with lower parent- and teacher-reported 
externalizing symptoms (Racz & McMahon, 2011), suggesting a cross-context influence. Thus, 
one might expect lower externalizing symptoms across contexts and potentially greater parent- 
teacher agreement on these symptoms among youth with more parental monitoring. Similarly, 
positive parenting (e.g., praising a youth for positive behaviors) may increase youth engagement 
in emotion regulation strategies, which in turn may mitigate risk for internalizing and 
externalizing symptoms (Eisenberg et al., 2005). This should also have a cross-context impact 
and increase rater agreement. Examining other facets of parenting, such as involvement, may 
shed light on informant discrepancies given that both over-involvement and under-involvement 


has been associated with higher symptom levels (Scaramella & Leve, 2004). 
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Parental stress, such as lower social support, is also associated with informant 
discrepancies (Grills & Ollendick, 2002; Kolko & Kazdin, 1993) and is likely interrelated with 
positive parenting. For example, parents with greater social support often exhibit greater warmth 
and lower hostility towards their children (Lippold et al., 2018), which may be related to reduced 
symptoms across contexts and greater informant agreement. Additionally, increased parenting 
stress has been found to be associated with parent-teacher discrepancies in ratings of youth’s 
functioning (Yeguez & Sibley, 2016). Thus, an examination of whether social support is 
associated with rater consensus on youth’s symptoms is warranted. 

The Current Study 

The first aim of the current study was to examine agreement and discrepancy profiles 
between informants for youth’s internalizing symptoms and externalizing symptoms using a 
person-centered method, building on studies that have examined informant discrepancies using a 
variable-centered approach (e.g., Sinclair et al., 2019). This approach allowed for the 
identification of distinct subgroups of individuals that varied in the severity of caregiver, teacher, 
or youth symptom reports and may be differentially associated with course, correlates, outcomes, 
and intervention responses. There is a dearth of person-centered research in this area, and thus no 
clear prior research indicating specific patterns of concordance and discordance. However, given 
prior research indicating moderate correlations between multiple raters (e.g., De Los Reyes et al., 
2015) a pattern of concordance and at least one pattern of discordance was expected. Further, 
given prior work indicating lower levels of agreement on reports of internalizing versus 
externalizing symptoms (De Los Reyes & Kazdin, 2005), discordance between adults and youth 
on internalizing symptoms was expected. Consistent with a recent call to study factors associated 


with informant discrepancies (e.g., De Los Reyes et al., 2019a), this study sought to examine 
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malleable context- and rater-specific factors that may be associated with both agreement and 
discrepancies. In line with this recent research, the second aim of the study was to extend prior 
research by investigating whether school engagement and/or parenting behaviors and social 
supports were associated with profile membership. Based on the literature reviewed above, it 
was expected that the fewest rater discrepancies would emerge for youth who reported higher 
levels of school engagement and connectedness, as well as for youth whose caregivers had the 
most social support and engaged in higher levels of parental monitoring, involvement, and 
positive parenting, as opposed to those who engaged in inconsistent parenting and discipline. 
Method 

Participants 

The study sample included a teacher screening process to identify 346 seventh-grade 
students (M age = 12.47 +/- 0.60 years) manifesting elevated levels of aggressive behavior; for 
each student, the sample also included a caregiver and one core teacher. The data came from 20 
middle schools across two urban school districts in a Mid-Atlantic state. The student sample was 
56% male and mostly Black (i.e., 75%). The demographic composition of this sample was 
aligned to the 2016-17 school-level demographics, which on average, included a student body of 
which 68% of students were Black, 18% White, and 9% Hispanic/Latino. The schools in the 
study had an average enrollment of 560 students (range = 332-800). 

[INSERT Table 1 HERE] 

Procedures 

The main study was conducted collaboratively by three universities, all of which received 
Institutional Review Board approval. Sixth grade teachers completed a universal, six-item 


screening measure assessing student proactive and reactive aggression in the spring (Lochman, 
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& Conduct Problems Prevention Research Group, 1995). Students who received a score of 11 
(i.e., possible range of 6-30), tending to be ranked in the top 25% of the student body for 
aggressive behaviors, were recruited for participation in the study during the following year (i.e., 
the fall of seventh grade) and comprise the study sample. Participation was voluntary. Caregivers 
and students provided consent and assent, respectively. All study data were collected at baseline 
(i.e., during the fall of seventh grade), prior to participation in the Early Adolescent Coping 
Power preventive intervention (Bradshaw, Lochman, Powell, & Ialongo, 2017). 

Measures 

Youth and Family Demographics. Student demographic data were collected in a survey 
adjoined to the Behavior Assessment System for Children 2 (BASC-2: Adolescent [ages 12-21]; 
Reynolds & Kamphaus, 2004). 

Internalizing and Externalizing Symptoms. Teachers, caregivers, and youth reported 
on youth’s symptoms using the BASC-2: Adolescent, ages 12-21 (Reynolds & Kamphaus, 
2004). Teachers and caregivers reported on three overlapping externalizing behavior scales 
(aggression, conduct problems, and hyperactivity), whereas youth only completed one scale (i.e., 
hyperactivity); thus, youth-reported externalizing symptoms were not included in the analyses. 
The externalizing scales included aggression (10 items for teacher report, a = .71; 10 items for 
caregiver, o = .88; all alphas reported are from the larger intervention study), conduct problems 
(12 items for teacher report, o = .91; 14 items for caregiver, a = .87), and hyperactivity (11 items 
for teacher report, a = .78; 8 items for caregiver, o = .81). Teachers, youth, and caregivers 
reported on three scales of internalizing behaviors, including: anxiety (7 items for teacher report, 
a = .81; 11 items for caregiver, a = .86; 13 items for youth, o = .83); depression (11 items for 


teacher report, o = .83; 12 items for caregiver, a = .86; 12 items for youth, a = .85); and 


INFORMANT DISCREPANCIES IN SYMPTOMS 10 


somatization (8 items for teacher report, a = .83; 11 items for caregiver, « = .79; 7 items for 
youth, a = .69). Each informant rated the frequency of the behaviors over the past 6 months on a 
three-point Likert scale ranging from 0 (“never”) to 3 (“always”). A summed score was created 
for each scale, and the scores were converted into t-scores, which were used in this study. The 
BASC has demonstrated adequate reliability and validity (Reynolds & Kamphaus, 2002). 

Parenting. The Alabama Parenting Questionnaire-Parent Version (APQ; Shelton, Frick 
& Wootton, 1996), a 42-item questionnaire, was used to assess caregiver report of their own 
involvement, positive parenting, monitoring, and inconsistent discipline. The involvement scale 
included 10 items (a = .88; e.g. item, “You play games or do other fun things with your child”). 
The positive parenting scale was a 6-item scale (a = .87; “You let your child know when he/she 
is doing a good job with something”). The monitoring scale included 10 items (a = .78; e.g., 
“Your child goes out without a set time to be home”). The inconsistent discipline scale included 
6 items (a = .76; e.g., “You threaten to punish your child and then do not actually punish 
him/her”). Caregivers reported on the frequency of their parenting behaviors on a four-point 
Likert scale from 1 (“never”) to 4 (“always”) and items were summed for each scale. Higher 
scores reflect higher involvement, positive parenting, monitoring, and inconsistent discipline. 
The APQ has demonstrated reliability and validity in an adolescent sample (Hurley et al., 2014; 
Zlomke et al., 2014). These scales were included in auxiliary analyses. 

Caregiver Social Support. The Exosystem Social Support Scale is a 21-item self-report 
index of social support that was an adapted form of the Social Support Questionnaire (Sarason et 
al., 1983) and administered to caregivers. Each caregiver indicated whether a series of 
individuals (e.g., grandparent, cousin) provided social supports in his/her life and then indicated 


whether they were satisfied with each individual’s support of their care for the child. Responses 
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were rated on a six-point Likert scale from 0 (“very dissatisfied”) to 5 (“very satisfied”). The 
number of supports were summed to reflect the total social support (i.e., total number of 
individuals who provided the caregiver with social support). The summed satisfaction score 
reflected the caregivers’ level of social support satisfaction with the child-specific social support 
they received. Both measures were included in auxiliary analyses. 

School Engagement. Youth reported on four facets of school engagement by completing 
the Youth Self-Report of School Climate, a validated measure of school climate demonstrating 
theoretical model fit and measurement invariance across student gender, race/ethnicity, and 
school grade (Bradshaw et al., 2014). The academic engagement scale (4 items; e.g., “My 
teachers believe that I can do well in school”; a = .75) measures perceptions of attaining 
academic success. The connection to teachers scale (6 items; e.g., “My teachers listen to me 
when I have something to say’, a = .77) reflects connectedness to all of the student’s teachers. 
The whole-school connectedness scale (4 items; e.g., “I enjoy learning at this school”, o = .83) 
measures student’s feelings about their school experience. The student connectedness scale (5 
items; e.g., “Students respect one another”, « = .73) measures how the student perceives student 
relationships and bonding to one another. All items were rated on a four-point Likert scale from 
1 (“strongly disagree”) to 4 (“strongly agree”) and were summed to create each subscale (see 
Bradshaw et al., 2014). These scales were included in auxiliary analyses. 

Statistical Analyses 

Bivariate correlations and descriptive statistics were conducted using SPSS Version 25 
(IBM, 2016). Two latent profile analyses (LPA) were conducted in Mplus Version 8 (Muthén & 
Muthén, 1998-2017) to identify profiles of caregiver-, youth-, and teacher-reported agreement 


regarding youth internalizing symptoms (first LPA), and caregiver- and teacher-reported 
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agreement regarding externalizing symptoms (second LPA). Given that the sample was 
comprised of youth attending 20 schools, the data were nested. Nesting was controlled for in the 
analyses by utilizing the TYPE = complex command. Full Information Maximum Likelihood 
(FIML) estimation was used to estimate missing data (Enders, 2001). 

In the latent profile analysis, models were built in an iterative fashion (i.e., beginning 
with a single class and adding one additional class until fit was determined inadequate). Several 
model fit indices were evaluated to determine the model that best fit the data. These included the 
Akaike Information Criterion (AIC; Akaike, 1987), Bayesian Information Criterion (BIC; 
Schwartz, 1978), sample-size adjusted BIC (ABIC; Sclove, 1987), the Vuong-Lo-Mendell-Rubin 
(VLMR) Likelihood Ratio Test, and entropy (Masyn, 2013; Nylund, et al., 2007). A decreasing 
AIC, BIC, and adjusted BIC, a higher entropy, as well as a statistically significant VLMR 
Likelihood Ratio Test generally indicate better model fit (Ramaswamy, DeSarbo, Reibstein, & 
Robinson, 1993). The VLMR Likelihood Ratio Test compares the fit of the model with n profiles 
to the fit of the model with n-1 profiles (Masyn, 2013). Entropy reflects the degree of 
classification certainty; values closest to 1.00 and posterior probabilities greater than .70 are 
favorable (Nagin, 2005; Ramaswamy et al., 1993). Class sample size was also considered, as 
profile sizes less than 5% of the sample may indicate an over-fitted model. Last, each class was 
examined to determine whether they were distinct and conceptually meaningful. Once the 
internalizing and externalizing LPA models were selected, auxiliary analyses were conducted 
using omnibus chi-square tests. These tests were conducted to test the equality of means of the 
targeted variables (i.e., caregiver reports of involvement, positive parenting, monitoring, 
inconsistent discipline, total social support, and child-specific social support and student reports 


of academic engagement, connection to teachers, whole-school connectedness, and student 
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connectedness) across all profiles and provided chi-square values and an effect size (phi; ) for 
all omnibus chi-square tests (Masyn, 2013). Pairwise comparisons were examined only if the 
omnibus tests were significant (p < .05). 
Results 
Descriptive statistics and bivariate correlations for informant-reported internalizing and 
externalizing scales, as well as informant-reported symptoms and the auxiliary variables (e.g., 
caregiver-reported involvement) are shown in the appendices. Results from the primary analyses 
are below. 
Latent Profile Analysis for Internalizing Symptoms 
An LPA was fit using the t-scores for the caregiver-, youth-, and teacher-reported 
subscales of internalizing symptoms (i.e., anxiety, somatization, and depression). For the 
internalizing model, the BIC, AIC, and adjusted BIC decreased from the one-profile model to the 
two-profile model, the sample sizes of both classes were adequate, and the VLMR Likelihood 
Ratio Test showed a trend for significance (p = .09). Although the BIC decreased in the 3-profile 
model, the VLMR Likelihood Ratio Test was not significant and it included a class that was very 
small. Thus, the 2-profile model was selected (see Table 2). Profile 1 (n = 240, 69%) was labeled 
“Low Symptoms Agreement,” as caregivers, youth, and teachers all agreed upon subclinical 
symptom levels (see Figure 1A). Profile 2 (n = 106, 31%) was labeled “Youth-Reported High 
Somatization and Anxiety” (referred to hereafter as Youth High Internalizing), as youth reported 
symptoms above the at-risk cutoff (t-scores > 60) and discordant with the below at-risk caregiver 
and teacher reports. All informants reported at-risk levels of depression. 
[Insert Table 2 About Here; Insert Figure 1 About Here] 


Auxiliary Analyses for Internalizing Symptoms Model 
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Parenting. Significant between-profile differences were found regarding parental 
monitoring (y7 = 10.32, p < .01, @ = .17) and inconsistent discipline (y? = 4.33, p < .04, » = .11). 
Caregivers of youth in the Low Symptoms Agreement profile reported higher monitoring and 
lower inconsistent discipline than caregivers of youth in the Youth High Internalizing profile (see 
Table 3). There were no significant differences for involvement or positive parenting. 

[Insert Table 3 About Here] 

Caregiver Social Support. There were no between-profile differences. 

School Engagement. There were significant between-profile differences for academic 
engagement and connectedness. Youth in the Low Symptoms Agreement profile reported greater 
academic engagement (y* = 27.93, p < .01, @ = .28), connection to teachers (x? = 20.88, p < .01, 
= .25), school connectedness (7? = 21.59, p < .01, ) = .25) and student connectedness (y? = 
16.35, p < .01, @ = .22) than youth in the Youth High Internalizing profile. 

Latent Profile Analysis for Externalizing Symptoms 

An LPA was conducted including caregiver- and teacher-reported externalizing 
symptoms (i.e., conduct problems, hyperactivity, and aggression). Moving from a one- to a four- 
profile model resulted in a decrease in the AIC, BIC, and adjusted BIC and distinct classes. 
However, the VLMR Likelihood Ratio Test was not significant for the 4-class model and had a 
class with a very small sample size (~8.0%). Given that the 3-profile model showed a significant 
VLMR Likelihood Ratio Test, had good entropy, and the classes identified were distinct and had 
adequate sample sizes, the 3-profile solution was selected (see Table 2). Profile 1 (n = 216, 
63%), was named “Low Symptoms Agreement,” as caregivers and teachers in this profile 
reported agreement on low symptom levels below the at-risk cutoff (t-scores < 60; see Figure 


1B). Profile 2 (n = 59, 17%) was labeled “Teacher-Reported High Externalizing” (referred to 
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hereafter as Teacher High Externalizing), as teachers in this profile consistently reported higher 
levels of externalizing symptoms (t-scores > 70), which was discordant with caregiver reports. 
Profile 3 (n = 69, 20%) was labeled “Caregiver-Reported High Externalizing” (referred to 
hereafter as Caregiver High Externalizing), as caregivers in this profile consistently reported 
higher and clinically significant conduct disorder symptoms and hyperactivity (t-scores > 70), 
which were discordant with teacher ratings. Both caregivers and teachers reported clinical levels 
of aggression. 
Auxiliary Analyses for Externalizing Model 

Parenting. There were significant between-profile differences regarding monitoring (7 
= 9.34, p < .01, » = .16) such that caregivers of youth in the Low Symptoms Agreement profile 
reported higher monitoring than caregivers of youth in the Caregiver High Externalizing profile 
(y° = 9.33, p < .01, ) = .16; see Table 4). There were significant differences in caregiver-reported 
inconsistent discipline (v7 = 12.38, p < .01, @ = .19) such that the caregivers of youth in the 
Caregiver High Externalizing profile reported higher inconsistent discipline compared to 
caregivers of youth in the Low Symptoms Agreement profile (v7 = 11.61, p < .01, @ =.18) and the 
Teacher High Externalizing profile (y* = 5.46, p < .02, o = .13). There were also significant 
differences for caregiver-reported positive parenting (y* = 8.17, p < .02, @ = .15) such that 
caregivers in the Teacher High Externalizing profile reported higher positive parenting than 
caregivers in the Low Symptoms Agreement profile (y? = 7.49, p < .01, @ = .15). 

[Insert Table 4 About Here] 
Caregiver Social Support. There were no significant between-profile differences. 
School Engagement. There were significant differences for academic engagement, (x7 = 


15.42, p < .01, = .21), such that youth in the Teacher High Externalizing profile reported lower 
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academic engagement than youth in the Low Symptoms Agreement profile (y? = 13.48, p < .01, 
= .20) and the Caregiver High Externalizing profile (y? = 13.89, p < .01, = .20). No significant 
differences were found for whole-school, teacher, or student connectedness. 

Discussion 

Previous research has predominantly examined the degree of correspondence in 
informant reports of youth’s behavior problems using variable-centered approaches (e.g., 
Roskam et al. 2018). This study sought to extend prior research using multi-informant data by 
employing a person-centered approach to identify profiles of rater agreement and discrepancy of 
youth’s internalizing and externalizing symptoms. Further, whether and how membership in 
these profiles was associated with several factors was examined, representing the intersection of 
context and raters (e.g., parenting behaviors and youth-reported school engagement). Two 
profiles were identified for internalizing symptoms and three profiles were identified for 
externalizing symptoms, both of which differed in the frequency and quality of informant reports 
of children’s symptoms. Profiles also differed in reported parenting behaviors and school 
engagement, highlighting the importance of considering multiple informants and contexts in 
which youth are embedded. 

Regarding the internalizing symptom profiles, the majority of the sample (i.e., 69%) were 
in the Low Symptoms Agreement profile, which was characterized by agreement among all three 
raters, whereby each informant reported generally low symptom levels that were below the at- 
risk cutoff (t-scores < 60). The second profile, Youth High Internalizing, included 31% of the 
sample, whereby youth were rated by all raters as exhibiting signs of depressions, and (only) 
youth reported at-risk levels of somatization and anxiety. This class is consistent with prior 


literature that has shown that discrepancies for internalizing symptoms often arise between youth 


INFORMANT DISCREPANCIES IN SYMPTOMS 17 


self-report and caregiver and teacher reports (De Los Reyes et al., 2015) and extends previous 
work by showing that informant disagreement may be more likely to occur with somatization 
and anxiety rather than depression. Given this finding, future assessments should measure 
specific facets of internalizing behaviors, rather than broadband internalizing symptoms. 
Previous work has also demonstrated the presence of informant discrepancies across different 
symptoms of depression in youth (Cole et al., 2017). Moreover, future work is needed to identify 
factors that contribute to the greater observed teacher-parent agreement in depressive symptoms 
as compared to anxiety and somatization. Youth in this class may have been experiencing 
anxiety symptoms and somatization that parents and teachers were unable to detect. The 
presence of this profile highlights the importance of considering youth report and suggests that 
greater education of parents and teachers regarding what anxiety and somatization may look like 
and h manifest may improve parent and teacher detection of internalizing symptoms among 
youth. 

Youth in the Low Symptoms Agreement profile had caregivers who reported higher 
monitoring and consistent discipline, compared to caregivers of youth displaying internalizing 
symptoms. This finding is consistent with research that higher parental monitoring and consistent 
discipline reduce risk for internalizing symptoms (Balan et al., 2017; Lionetti et al., 2018). 
Caregiver monitoring may be associated with increased communication between a caregiver and 
their child, which may play a role in increased caregiver-youth agreement. Caregivers of students 
displaying internalizing symptoms reported more inconsistent discipline, which aligns with work 
linking inconsistent parenting to higher levels of internalizing symptoms (Balan et al., 2017; 
Lionetti et al., 2018). The unpredictability of parental disciplinary responses to youth may cause 


them to feel insecure in their relationships or may be experienced as harshness or hostility by 
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youth, which could contribute both to feelings of anxiety and depression (Balan et al., 2017; 
McLeod, Weisz, & Wood, 2007). 

Youth in the Low Symptoms Agreement profile reported significantly greater academic 
engagement, connections to teachers, school connectedness, and student connectedness, with 
small to moderate effect sizes observed. Students who are more committed to school work and 
have better relationships with their teachers may be less likely to exhibit internalizing symptoms, 
potentially because they are performing well academically and view teachers as supportive of 
their learning and development (Rolland, 2012). On the other hand, students with fewer 
internalizing symptoms may find it easier to excel in school and develop relationships with peers 
and teachers (Hurd, Hussain, & Bradshaw, 2018). Thus, higher levels of school engagement may 
be associated with lower cross-context internalizing symptoms, resulting in agreement across 
raters on these symptom levels. 

Three profiles were identified for externalizing symptoms: (1) Low Symptoms Agreement, 
(2) Teacher High Externalizing, and (3) Caregiver High Externalizing. The Low Symptoms 
Agreement profile demonstrated consistent agreement across raters of low symptom levels 
(average t-scores < 57) for 63% of students, which was unexpected given that these youth were 
screened into this study for externalizing problems. The presence of this profile provides support 
for looking at subgroups within a sample. Within this sample of youth with relatively higher 
levels of aggression on a universal screening, there was still a subgroup of youth with less severe 
symptoms. There were two groups displaying externalizing symptoms, in which rater 
discrepancies emerged. Teachers reported clinical levels of externalizing symptoms across all 
scales for 17% of the sample, whereas caregivers reported subclinical levels of symptoms on all 


scales. Teachers may have different behavioral expectations (e.g., sitting still, requiring 
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permission to speak) compared to caregivers; some children may have trouble adhering to these 
expectations, resulting in higher teacher reports of externalizing symptoms than caregivers. 
Alternatively, youth may exhibit high externalizing symptoms across both contexts, but 
caregivers and teachers have different thresholds for problematic behavior. 

Caregivers reported higher levels of positive parenting and lower levels of monitoring 
among youth in the Teacher High Externalizing profile, as compared to caregivers in the Low 
Symptoms Agreement profile. A parent who reports positive behaviors in conjunction with lower 
levels of monitoring may be engaging in permissive parenting, which has been associated with 
externalizing behaviors (Pinquart, 2017). Caregivers also reported higher levels of inconsistent 
discipline for youth in the Caregiver High Externalizing profile compared to caregivers in the 
other profiles. It may be more difficult for a caregiver to consistently discipline and monitor a 
child who is exhibiting externalizing symptoms. Children may also receive inconsistent 
messages regarding what behavior is appropriate and/or may perceive parental reprimands as 
unpredictable, which may increase the likelihood of externalizing behaviors. 

Youth in the Teacher High Externalizing profile reported the lowest levels of academic 
engagement, which is consistent with previous research showing that teachers report higher 
levels of symptoms among youth with school-specific difficulties (De Los Reyes & Kazdin, 
2005; Totura et al., 2009). The discrepancies that were found between caregiver- and teacher- 
reported externalizing problems may be better understood if youth report was included, as youth 
could provide further insight as to why they may be exhibiting different symptoms across 
contexts or why their symptoms are being perceived differently. For example, youth may be 
exhibiting higher levels of externalizing symptoms if they are also experiencing factors 


associated with decreased school engagement (e.g., bullying or low school connectedness) that 


INFORMANT DISCREPANCIES IN SYMPTOMS 20 


has gone unrecognized by teachers. Additionally, incorporating more objective measures of 
school engagement, such as attendance or change in academic performance, could help elucidate 
other aspects of the school environment that are associated with informant discrepancies. 

There are some limitations of the present study to acknowledge. Youth self-report of 
externalizing symptoms was not included in the analyses given that youth do not complete the 
same BASC-2 scales as adult reporters. Similarly, teacher ratings of the classroom climate, 
expectations, or connectedness to students were not available. Future studies should incorporate 
such teacher-reported variables as well as caregiver-reported behavioral expectations at home to 
determine whether the symptom discrepancies by rater encompass a contextual or expectations 
discrepancy. An additional avenue for future work is to assess youth perceptions of their 
caregiver’s parenting since discrepant parent-adolescent perspectives of parenting have also been 
found to be associated with internalizing and externalizing symptoms (De Los Reyes et al., 
2019b). The sample of youth were identified through a pre-screening process as having higher 
levels of aggression; thus, replication of these findings is needed in other population-based 
samples (e.g., community-based settings) or samples identified for other behavioral or mental 
health problems (e.g., internalizing symptoms). Notably, there was still a sizeable sample of 
youth with internalizing symptoms and those without clinical levels of aggression (or other 
externalizing behaviors), as well as rater variability in the report of aggression. This study was 
cross-sectional and causality cannot be inferred. Additional longitudinal research examining how 
youth symptoms influence parenting and school engagement is needed. Within the broader study 
from which these data were collected, the main research focus was on assessing the efficacy of 
the Early Adolescent Coping Power intervention (Bradshaw et al., 2017), which takes an 


ecological approach to address youth aggression by targeting the skills of students, parents, and 
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teachers. An examination of whether the intervention was more or less efficacious with students 
in these varying subgroups is an additional area for further research. 
Conclusion 

Informant discrepancies in children’s behavior problems have long been considered a 
nuisance by researchers and clinicians alike and have often been interpreted as a problem when 
administering assessments and developing treatments plans. While some researchers have 
attempted to understand informant discrepancies by examining the associations between rater 
reports within a sample, few studies have attempted to identify (a) distinct profiles of individuals 
that vary in their frequency and level of symptoms across informant reports, or (b) what factors 
are associated with profile membership for informant agreement or disagreement on youth’s 
symptoms. Building on previous work, this study utilized a person-centered approach, allowing 
for the examination of patterns of informant agreement or disagreement in reports of 
internalizing and externalizing behaviors. Further, this study identified factors (i.e., parenting and 
school engagement) that were associated with the identified profiles. Study findings highlight 
several potential points of intervention. For example, teaching parenting skills, such as 
monitoring, may be especially important during adolescence when youth begin to communicate 
less with their caregivers or when adolescents are misbehaving in the classrooms as reflected in 
higher levels of teacher-reported externalizing symptoms. In addition, given that adolescence is 
characterized by numerous maturational changes and a general rebellion towards authority 
figures, the importance of maintaining youth’s engagement to school is essential to ensure the 
development of positive behaviors, rather than those that are disruptive and interfere in their own 
and other students’ learning and potential. Greater communication between school personnel, 


parents, and youth may also aid in the detecting of symptoms that are occurring in specific 
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environments or across environments, thereby allowing for the development of appropriate 
support systems and interventions that may help attenuate youth’s symptoms not only during 


adolescence, but across the developmental course. 
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Table 1 


Student and Caregiver Demographic Information for the Sample 


Student race n(%) 
Black 258 (75%) 
White 37 (11%) 
Latino/Hispanic 25 (7%) 
Other 24 (7%) 
Student gender 

Female 152 (44%) 
Male 193 (56%) 


Parental marital status 


Married 22 (22%) 
Single 55 (56%) 
Divorced 15 (15%) 
Separated 4 (4%) 
Other 3 (3%) 
Annual income 

< $10,000 17 (18%) 
$10,000 - $29,000 32 (34%) 
$30,000 - $49,000 28 (29%) 
$50,000 - $99,000 10 (11%) 


> $100,000 


8 (8%) 
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Table 2 
Fit Indices for Each Latent Profile Analyses 
Internalizing Model 
Number Number of Log AIC BIC ABIC VLMR_ Entropy 
of free likelihood LRT 
profiles parameters 
1 18 -9975.40 19986.80 20056.04 19998.94 os aig 
2 28 -9820.85 19697.71 19805.41 19716.58 .09 .79 
3 38 -9731.39 19538.78 — 19684.95 19564.40 29 .86 
Externalizing Model 
Number Number of Log AIC BIC ABIC VLMR _ Entropy 
of free likelihood LRT 
profiles parameters 
1 12 -6614.27 13252.53 = 13298.62 13260.55 -- -- 
2 19 6321.86  12681.71 1275469 12694.41  .002 ‘85 
3 26 -6230.07 12512.14 12612.00 12529.52 .03 84 
4 33 -6145.46 12356.92  12483.67 — 12378.98 .68 .80 


Note. AIC = Akaike Information Criterion, BIC = Bayesian Information Criterion, ABIC = Sample- 
size Adjusted BIC, VLMR LRT = Vuong Lo-Mendell Rubin Likelihood Ratio Test. VLMR LRT 


and entropy are not calculated for the 1-profile model. Profiles bolded are the best-fitting and 
selected models. 
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Table 3 


Results of Auxiliary Analyses for the 2-Profle Model of Internalizing Symptoms 


Low Symptoms Youth-Reported Omnibus ? test Pairwise 
Agreement High Comparisons®* 
(Profile 1; Somatization and 

n= 240) Anxiety 
(Profile 2; 
n= 106) 


M SD M SD %G Pp A 


Parenting (CR) 


Involvement 25.87 8.70 24.35 7.28 2.76 10 .09 -- 
Positive Parenting 19.80 4.01 19.39 4.52 0.61 43 04 -- 
Monitoring 33.67 8.21 31.61 8.03 10.32 <0.01 17 1>2 
Inconsistent Discipline 7.32 4.45 8.69 6.31 4.33 .04 11 2>1 
Caregiver Total Social 6.07 3.70 6.74 7.39 0.61 43 .04 -- 
Support 

Caregiver Social Support- 22.52 13.35 23.62 36.97 0.07 79 01 -- 
Satisfaction 

School Engagement (YR) 

Connection to Teachers 12.94 3.86 10.67 3.39 20.88 <0.01 25 1>2 
Academic Engagement 11.08 2.60 9.60 2.48 27.93 <0.01 28 1>2 
Whole-School Connectedness 9.25 2.99 7.37 2.99 21.59 <0.01 25 1>2 
Student Connectedness 10.50 3.27 8.22 4.49 16.35 <0.01 22 1>2 


Note. CR = caregiver report, YR = youth report. 
*For significant omnibus tests, all pairwise comparisons are significant at the p < .05 level. 
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Table 4 
Results of Auxiliary Analyses for the 3-Profle Model of Externalizing Symptoms 
Low Symptoms Teacher- Caregiver- Omnibus ¥? test Pairwise 
Agreement Reported High Reported High Comparisons® 
(Profile 1; Externalizing Extermalizing 
n= 216) (Profile 2; (Profile 3; 
n= 59) n= 69) 

M SD M SD M SD x? D i) 
Parenting (CR) 
Involvement 25.50 6.44 25.94 8.66 24.06 9.10 1.83 40 .07 -- 
Positive Parenting 19.40 3.06 21.03 5.15 19.26 4.82 8.17 02 15 2>1 
Monitoring 33.67 6.76 32.80 11.60 29.75 11.88 9.34 01 .16 1>3 
Inconsistent 7.16 4.84 7.51 6.30 11.33 9.33 12.38 <0.01 .19 3>2,1 
Discipline 
Caregiver Total 6.61 3.09 5.96 6.30 5.64 10.05 2.41 30 .08 -- 
Social Support 
Caregiver Social 23.37 15.28 22.02 15.82 21.49 39.46 0.47 .79 .04 -- 
Support- 
Satisfaction 
School Engagement (YR) 
Connection to 12.48 3.34 11.34 2.91 12.23 3.36 5.97 05 13 -- 
Teachers 
Academic 10.88 2.42 9.38 2.80 10.83 1.84 15.42 <0.01 21 1,3>2 
Engagement 
Whole-School 8.69 3.35 8.54 3.08 8.73 2.64 0.14 94 02 -- 
Connectedness 
Student 9.82 3.23 9.73 4.80 10.04 2.84 0.37 83 .03 -- 
Connectedness 


Note. CR = caregiver report, YR = youth report. 


*For significant omnibus tests, all pairwise comparisons are significant at the p < .05 level. 
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Figure 1. A. Caregiver-, youth-, and teacher-reported internalizing symptoms for each profile in the two profile-model; and B. 
Caregiver- and teacher-reported externalizing symptoms for each profile in the three-profile model. 

CR = caregiver report, YR = youth report, TR = teacher report, Som = somatization, Anx = anxiety, Dep = depression. Agg = 
aggression, CP = conduct problems, Hyper = hyperactivity. 

At-Risk T-Score: 60-69; Clinical T-Score: > 70. 
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Appendix A 

Bivariate Correlations, Means, Standard Deviations, and n’s of Externalizing and Internalizing Subscales 

Variable 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

1. CR CP -- 

2. TR CP 4k W- 

3. CR Hyp LP PERE DERE as 

4. TR Hyp Ro]: ula A Aalaiins |c iia 

5. CR Agg BQ*E* BORER LT TERE BEER K- 

6. TR Agg BEE* BORER DOFRE TORRE BEER NK 

7. YR Anx .18* .02 10 -.03 .06 .05 -- 

8. CR Anx 2am -.10 42*** — -.05 27*** — -.07 25** -- 

9. TR Anx -.03 11 .03 .06 -.03 .09 .14* 18 -- 

10. YR Som .05 .02 -.02 -.05 -.03 .02 A5*** — -.03 .08 -- 

11. CR Som 25*** = -.02 .1*** — -.05 .21** -.02 21** 51*** 08 .15* -- 

12.TR Som .02 .15** .04 .05 .O7 ab7e* .03 .06 5eF* 5S** .18** -- 

13. YR Dep .17* .01 .04 -.12* .03 .00 Ore 16% S1OE** .40** .17* -.07 -- 

14. CR Dep 48*** 108 5B*** = 07 A8*** 07 OTEK 66EK 17 .07 ABtFF 12 2O**K We 

15. TR Dep .05 6*** 11 23*** 11 AQ*EK 1 A* 11 OEE 11 .03 B*** — DOFFE 1 OFF -- 
M 57.72 63.10 58.45 61.55 55.00 65.28 52.12 52.96 51.96 52.18 52.05 50.39 51.49 58.29 56.49 
SD 13.13 12.43 12.87 11.99 11.69 13.87 10.79 12.69 9.77 11.29 10.95 9.23 10.72 13.03 10.13 
n 219 339 220 338 219 337 292 217 339 337 219 339 334 217 338 
Range 39-105 43-99 36-103 42-95 38-102 44-104 33-82 30-91 39-103 40-47 38-91 43-92 40-86 39-105 42-100 


Note. TR = teacher report, CR = caregiver report, YR = youth report, CP = conduct problems, Hyp = hyperactivity, Agg = aggression, Anx = anxiety, Som = 
somatization, Dep = depression. 


At-Risk t-Score: 60-69; Clinical t-Score: > 70. 
*p <.05; **p <.01; ***p <.001. 
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Appendix B 


Bivariate Correlations, Means, Standard Deviations, and n’s of Externalizing Subscales, Internalizing 
Subscales, and Auxiliary Variables 
Variable CRInv CRPos CRMon_ CR Inc CR CRSS  YRCon YRAc YRWSC _ YR Stud 


Par Dis Total Sat Teach Engag Con 
1. CR CP -.15* -.06 -.27*#* AQ *** Te -.04 -.05 -.10 -.01 -.11 
2. TR CP -.03 .08 -.18* .03 -.06 01 -.09 -.15** 01 .06 
3. CR Hyp 02 .06 -.14 6*** — -.06 -.04 -.06 -.06 -.07 -.10 
4. TR Hyp 01 .09 -.09 12 -.10 01 -.04 -.12* .06 .08 
5. CR Agg -.12 -.05 -.24*#* — 39*** = - 08 -.04 -.04 -.13 -.02 -.06 
6. TR Agg -.01 12 -.13 .06 -.09 .03 -.12* -.16** -.03 01 
7. YR Anx -.12 -.01 -.18* 13 .08 .09 -. 32K DORK DORE BB FH 
8. CR Anx .03 .04 -.11 23*** O01 .00 -.02 -.05 -.06 -.14 
9. TR Anx 01 -.10 -.02 -.01 -.01 .06 -.08 -.05 -.11 -.13* 
10. YR Som -.14 -.02 -.23*** 05 .06 04 -.13* -.09 -.08 -. 20*** 
11. CR Som -.01 .08 SQ StEE 2 7EEE 213 02 -.05 01 -.04 -.06 
12. TR Som -.03 01 -.08 .08 .04 .09 -.09 -.02 -.08 -.05 
13. YR Dep -.04 -.04 -.13 12 .14* .10 -. 33K BDRRK BD REE BG * EF 
14. CR Dep -.12 -.02 -.23*** — 3B*** = -.05 01 -.08 -.16 -.06 -.21 
15. TR Dep .00 .00 -.04 -.04 .00 .09 -.14* -.14* -.16** -.08 
M 25.40 19.67 33.00 7.77 6.28 22.87 12.25 10.62 8.67 9.83 
SD 5.01 3.25 5.71 3.92 3.82 18.16 3.54 2.25 2.89 3.20 
n 197 200 195 202 204 199 323 327 o2y 285 
Range 10-36 9-24 14-36 0-18 1-20 0-79 1-19 1-13 1-13 1-16 


Note. TR = teacher report, CR = caregiver report, YR = youth report, CP = conduct problems, Hyp = hyperactivity, 
Agg = aggression, Anx = anxiety, Som = somatization, Dep = depression, Inv = involvement, Pos Par = positive 
parenting, Mon = monitoring, Inc Dis = inconsistent discipline Total SS = total social support, SS Sat = social 
support satisfaction, Con Teach = connection to teachers, Ac Engag = academic engagement, WSC = whole-school 
connectedness, Stud Con = student connectedness. *p<.05; **p <.01; ***p<.001. At-Risk T-Score: 60-69; Clinical 
T-Score: > 70. 


